Papers with self-alignment objective
Multi-Task Representation Alignment on Language Understanding: A Mutual Information Perspective (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to multitask learning fail to address task interference issues . Existing methods focus on task balancing or probabilistic modeling but fail to learn sufficient representations for all target tasks. |
| Approach: | They propose a multi-task representation alignment framework to achieve task-specific alignment and self-alignment on shared representations from a mutual information perspective. |
| Outcome: | The proposed framework outperforms 13 representative MTL methods under label-noisy and data-constrained conditions. |